00:00
2026-06-30
aclanthology.org
large-language-models
Diet-KIT: Post-Training Quantization for Speech LLMs
Researchers from the Karlsruhe Institute of Technology developed Diet-KIT, a post-training quantization system that compresses the Qwen2-Audio-7B speech LLM from 16 GB to 3.98 GB while maintaining traβ¦